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L INTRODUCTION 



A. THE PROBLEM 

Asymptotic analysis is important in many areas of modern science, such 
as the theory of probability, complex analysis and applied mathematics. 

Because the factorial function and its asymptotic behavior are often 
needed in mathematics and engineering, Stirling's formula 



is one of the most important and frequently used asymptotic formulas. The 



one as n tends to infinity. 

There are several ways to prove Stirling's formula. For example, one can 
take the logarithm of n! and use Wallis's formula to obtain the factor of 
( 7t por this type of proof, see [Ref. 1 1 . 

Alternatively, one can start with the integral representation 



and use Laplace's method for integrals to evaluate it asymptotically. 
See [ Ref. 2 1 for this type of approach. 




( 1 ) 



notation in (1) means that the ratio of the left side and the right side tends to 
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All these methods use many techniques from mathematical analysis and 
some of them are quite sophisticated. We will pursue a new way to prove 
Stirling's formula using a discrete or combinatorial approach. 

This method of proof was mentioned as a research problem in fRef. 3 1. 
and the purpose of this thesis is to present a solution to this problem. 

B. MOTIVATION 

From (1), Stirling's formula can also be written as 



n 

n 









2 — <T> ■ 



Imagine a box filled with n distinct balls. We shall select balls at random 
with replacement. The motivation for our approach comes from noting that 
n!/n" is the probability of selecting n distinct balls consecutively while 
(2rcn) 1/2/2 is the asymptotic expected number of distinct balls obtained 
before a repetition as n — >». These expressions appear in Stirling's formula 
as written above thus indicating that a combinatorial proof might be possible. 
The purpose of the next section is to define the combinatorial set up in more 
detail. 
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n. COMBINATORIAL SET UP 



A. DEFINITION OF THE GAME 

Imagine a box filled with identical balls numbered from one to n. We 
draw a ball from the box at random, write down its number, and replace it, 
mixing the balls well so that our next draw is also made at random. If we 
continue this process we will eventually get a repetition for there are only n 
distinct balls and we must certainly repeat a number by our (n+l)®‘ draw. 

We are interested in the task of drawing out all n balls consecutively in 
this manner. We mean by this that after n consecutive draws, recording the 
numbers as we draw, we wish to obtain a permutation of the sequence (1,2,3, 
... ,n). If we obtain a repetition before the desired result, then we start over 
from the beginning. 

The following three questions are of interest: 

• What is the average or expected number En of distinct balls obtained 
before a repetition occurs? 

• What is the average or expected total number Tn of distinct balls 
(adding up the number of distinct balls obtained in the first game, the 
second game ... etc.) selected before obtaining n consecutive distinct 
balls (i.e., some permutation of (1,23/ - /H) ). 

• What are the asymptotics of En and Tn as n — >«« ? 

B. THE AVERAGE OR EXPECTED NUMBER OF DISTINCT BALLS BEFORE 

A REPETITION 

Let pj be the probability that we get exactly j distinct balls before a 
repetition. In other words, since only j distinct balls are obtained, pj is the 
probability of getting a repetition on the (j+l)*‘ draw, and not before. 
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Since we assume each draw is independent, the probability of drawing a 
specific ball at any time is just 1 /n. We always obtain at least one distinct ball 
in any play of the game. To obtain exactly one distinct ball in a game we must 
get a repetition on our second draw. The probability of doing this is 1 /n and 
therefore the probability of obtaining only one distinct ball is 

1 

Pi = n . 

The probability pi also can be written as 

n-0 1 



To draw two distinct balls before a repetition we must get distinct balls 
on both the first and second draws. The third draw must then be a repetition 
of either the first or second draw. Thus we are looking for a three-tuple 
where the first two elements are distinct and the third element is a repetition 
of either the first or second element. Since all elements come from 
{1,2,3, ... , n}, there are a total of n^ three-tuples, with only 2 n- (n-1) meeting 
the above requirement. Therefore, 

n-0 n-1 2 
n n n 

In the same way. 



and clearly 



P3 



n-0 n-1 n-2 3 
n n n n 
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Let us 



Since 



setting j 



For j 



Pj 



n-0 n-1 n-2 n-3 n-j+1 j , . , _ - , 

i = -;r ;; (J = 1,2,3,... ,n). 



n n n n 



n n 



check that the sum of all probabilities is one, i.e. 



£pj = 1- 

j=i 



n gives 



Pn = 



= n-1. 



_ n-0 n-1 


n-2 


n-3 


n n 


n 


n 


_ j(n)(n-l)... 


(n-j+l) 




nj^^ 




_ n-0 n-1 


n-2 


n-3 


^ n n 


n 


n 


n! 






n 

n 






_ n-0 n-1 


n-2 


n-3 


n n 


n 


n 



n n 



n-n+1 n 
n n 



( 2 ) 



n n 



n-1 n-2 n-3 2 n-1 



n n n n n 



(n- l)(n-l)! n 

n-1 n 

n 
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(n-l)(n)! 

n 

n 

/ 



and for j = n-2, 

_ n-1 n-2 n-3 n-(n-2)+l n-2 

~ n n n n n 

_ n-1 n-2 n-3 ^ n-2 

n n n n n 



(n-2) (n-1)! 



n (n - 2) 
2 



n! 

n 

n 



In general, for 0 < j < n-1. 



n-1 n-2 n-3 n-(n-j)+l n-j 

n n n ■■■ n n 



(n-j) (n-1) (n-2)...G-H) 



(n-j)(n-l)(n-2)...(j-H) 



j! 

j! 



^ n^'\n- j) 

j! 



n! 

II 

n 
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We shall now sum each pj from pn to pi in reverse order beginning 
with 



Pn + Pn-i= [l+(n-l)]-^^ 

n 



n n! 

n 

n 



Continuing, 



n nl ,n (n-2) , n! 

P, + Pn-l+Pn-2 = — + 

n n 



,2n + n - 2n , n! 
^ 2 

n 



2 , 
2 n" 



and 



n n! n (n-3) n! 

Pn+Pn-l + Pn-2 + Pn-3 = ~2 V ^ 

n ■ n 



2 3 2 

3n +n -3n n! 
6 n" 



^ n" 



We claim that 
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Pn+Pn-1+--- +Pn-j = 



(0<j<n-l). 



n! 

n 

n 



n 



We can prove this by induction. Assume 



Pn+Pn-l+“- +Pn-k 



n! 

n 

n 




for some k < n-1 . This is the induction hypothesis. It holds for k = 1 
Then 

Pn+Pn-1+-" + Pn-k +Pn-(k+l) 



n! n*' ^ (n-k-1) n! 

(k^I)! 7 



= ill_ IL r 1 + iHiklli 
k! ^ (k+l) J 



n! n / n . 

~ u ^ic+r^ 

n 



This proves 



n! n 



k+l 



n 



n (k+l)! 



i 

k=0 



Pn-k = P 



n! 



n Pn-l Pn-j ~ jj ;j » 0 — j — n-1. 

n 



, 2, and 3. 



(3) 
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Equation (3) now implies 



n n-1 

EPk = ZPn-j 

k=l j=0 

_ n! n" ^ 

■ (iTT)! 
= 1 . 



What is the expected number En of distinct balls obtained before a 
repetition? This expression is 



E 



n 




Pl+2p2+3 P3+...+n Pn 



= Pl + P2 + P 3 +-- + Pn 
+ P2 + P3+... +Pn 

+ P3+... + Pn 



+ Pn 



= 1 + ( l-pi) + ( l-pi-p2) + ...+( l-Pl-P2-----Pn-l). 



From (3), 



1 -Pi - P2- ••• - Pj = Pj + i + Pj +2 ■*■••• + Pn 
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n-^1) 

= L Pn-k 



k=0 



n! 

n 

n 



n -(j+l) 

n 

(n-(j + l))! 



n - 1 n - 2 
n n 



n-j 

n ’ 



(l<j<n-l). 



Thus 



E 



n 



, n-l n-ln-2 n-ln-2 1 

1 + + + ... + ... - . 

n n n n n n 



( 4 ) 



C A RELATED GAME 

Now we consider a related game to simplify our later analysis. The rules 
for this new game are as follows: initially, we start with n distinct balls. Now, 
however, when we select a distinct ball and replace it, we also add a new ball 
numbered differently from all previous balls. For example, suppose we have 
just selected the distinct ball. Before our next draw, we replace the kd' 
ball and add a new ball numbered n+k, so that our next draw will be from a 
pool of n+k equally likely distinct balls. Thus, each time we draw out a 
distinct ball, the number of balls in the box increases by one. 

This game, like the previous one, ends when we get a repetition. 
However, unlike the first game, now it is possible in principle to obtain 
arbitrarily many distinct balls. 
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If the game ends, we empty the box and start over with the original n 
balls. 

Now, what is the expected number of distinct balls En* obtained when 
playing this second game? 

Let pj* be the probability that we draw out j distinct balls, i.e., repetition 
occurs on the (j+l)^* draw, and not before. 

Thus pi* is the probability that a repetition occurs on the second draw. 
Since we always get a distinct ball on the first draw, after the first draw, the 
box has n+1 balls. Therefore, 

• = 1 1 ^ J_ 

n n + 1 n+1 , 

In the same way, p 2 * is the probability that a repetition happens on the 
third draw, and not before. Therefore the first and second draws yield 
distinct balls so that after the first draw there are n+1 balls in the box, and 
after the second draw there are n+2 balls in the box. The probability of getting 
a distinct ball on the second draw is n/(n+l), and in order to get a repetition 
on the third draw, we have only two choices out of n+2 balls in the box. 
Therefore 



£. 2 
n n+1 n+2^ 



In the same way we find 



n n n 3 
n n+1 n+2 n+3 
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, _ n n n n n j 
~ n n+1 n+2 n+3 ‘ n+j-1 n+j 



Again we need to show that the sum of all probabilities is one. We argue 
as follows. 

_ . _ n 1 

n n+1 



= 1 - 



n 



n+1 



• • n..nn 2. 

Pi +P2 = (1 • iTiTHT2^ 



1 - - 2 .+ " ^ 



n+1 n+1 n+2 



= ‘-<HTT> 0- i4> 






pr + p2* p3* - 1 - 



n n n 
+ 



n+1 n+2 n+1 n+2 n+3 



n ^ , n 
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n n n 
n+1 n+2 n+3 



We claim 



k k 

Y . _ , n 

ifjPi ■ (n+l)(n+2)...(n+k) 



This is true for k=l. 

Assume for the induction hypothesis that 




(n+1) (n+2) ... (n+m) 



Then 



£pj* + Pm+l’ 
j=i 



m 



n 

(n+1) (n+2) . . . (n+m) 



+( 



n n n n m+1 
n n+1 n+2 ’"n+m n+m+1 



) 



= 1 



n 



m+1 



(n+1) (n+2) . . . (n+m) (n+1) (n+2) . . . (n+m) n + m+1 



= 1 



m 



( 



n 

(n+1) (n+2) ... (n+m) 



) ( 1 - 



m +1 , 

n + m+1 ^ 



(n+1) (n+2) . . . (n+m) (n+m+1) 

This concludes the induction proof. 

Note that the expression 
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can also be written as 



IPj- - 1 - 

j=i 



n 



(n+1) (n+2) ... (n+k) 



1 ■ iPj- = 

j=i 



(n+1) (n+2) ... (n+k) 



Now let us consider 



Since 



it follows that 



lim n 

k->oo (n+1 ) (n+2) . . . (n+k) 



lim 1 

k->oo 12 k 

(!+-)(!+-)... (H^) 

n n n 



1 + — — > oo as k — > oo 
n 



(5) 



lim n 

k-x» (n+1) (n+2) ... (n+k) 



= 0 . 



Letting k — >«» in (5), it then follows that 

ipi- = izipj- 

)=i j.i 



lim 



[1 



n 



k->oo (n+1) (n+2) . . . (n+k) 



14 



= 1 - 



lim n 

k->oo (n+1) (n+2) ... (n+k) 



= 1 



Now we shall find the expected number En* of distinct balls for this 
second game. The expected value En* is 



E ’ 



Skpk' 

k=l 



= Pl’ + 2p2* + 3 P3* + . 
= Pr+P2'+P3'+P4*+- 

+ P2* + P3*+P4*+. 

+ P3*+P4*+. 

+ P4*+ 



= l+(l-pi-) + [l -(Pi’+ P2*)] + ... + [1 - (p,*+ P2- + ...+ Pj-)] + 



, n n n n n 

1 + — : + ... + 



n 



n+1 n+1 n+2 



n+ 1 n+2 n+j 






( 6 ) 



Note that to derive (6) we have used (5). 
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D. ASYMPTOTICS FOR THE TWO GAMES 

We shall now study the expected values of the two games. No closed 
form expressions appear to exist for En and En* as given in (4) and (6). 
However our proof of Stirling's formula, as mentioned in the introduction, 
requires the asymptotic behavior of En as n — >oo. In this section we shall 
study the asymptotic behavior of En and En* . 

Recall that 



n 

En = Z >^Pk = 1 + 



k=l 



n-1 n-1 n-2 

+ + . 

n n n 



n-1 n-2 I 

^ n n n ’ 



and 



E 



n 



Z >^Pk‘ 



k=l 



i ^ 

1 + ^ + 

n+1 



n n n n n 
n+1 n+2 n+1 n+2 n+3 



Let 



n > 0 n-1 n-2 n - k 
n n n n 



(7) 



Pk 



n n n n 

n+0 n+1 n+2 *” n+k 



(8) 



Then ( 4) becomes 



£kPk = 



k=l 



n-1 

Z«k 



k=0 



(9) 
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while (6) becomes 



E„- = Skpk' = XPk 

k=l k=0 

We are going to show that 



( 10 ) 



n-l 

Z«k " 

k=0 k=0 



as n ---> CO 



or 



En En*. (n— >~). 



( 11 ) 



We shall do this in several steps which will be given in sections 1 through 4. 

1. An Inequality for En and a Partial Sum of En* 

The goal of this section is to obtain (15), an important inequality 
relating En to a partial sum of En*. 

To accomplish this, there is an inequality we shall need. It is 



1 - X < e , X > 0. 

1+x 



( 12 ) 



We prove the inequality (12) as follows : 

If X > 0, then - x < 0. By exponentiating both sides we get 
e-x < 1, or 1 - e-x > 0. 

If X < 0, then - x > 0. By exponentiating both sides we get 
e'’^ > 1, or 1 - e"’^ < 0. Define I(x) by 
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I(x) 




(1 -e‘‘)dt 



From the above inequalities, we conclude that 



However , 



I(x) > 0, if x?40 . 

X 

I(x) = t + e'* I 

* 0 

-X - 

= X + e - 1 . 



Consequently 



e > 1 - X, Xi^O. Q 3 ) 

Note that equality occurs in (13) only if x = 0. When x ^ 0, this 
expression yields the first inequality in (12). 

For the second inequality in (12), we note that (13) implies e^ > 1 + x, 
(x>0), or e*’^ < l/(l+x), (>^0). Returning to the problem, from (7) and (12) it 
follows that for 0 < k < n-1 

(i.k) 

n n n n 

li Jl 

^e" e" e"...e” 
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< 



1 1 1 




n 




n 




1 




n 



n n n n 

n+1 n+2 n+3 n+k 



= P 



k 



Therefore, 

< e ’" < Pjj, (0<k<n-l). 



(14) 



Summing the inequality in (14) we conclude that 



n -1 



k=0 



n-1 n-1 

Ze sXPk 

k=0 k=0 



(15) 



Note that (9), (10) and (15) imply 



E 



n 



> E, 



(16) 
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2. The Divergence of En and En* 

We shall need the following inequality, special cases of which will be 
useful later. This result is given as an exercise on page 60 of [Ref. 4 1 . 

If Pi > - 1 for i = 1, 2, ..., m where m > 1 and pi, P 2 , Pm are all 

positive or negative, then 



m 

na+tXi) > 1+Ztii 
i-l i-l 

We shall prove this by induction. For m = 2 the inequality holds since 
(1 + Pi) (I+P2) = I+P1 + P2+P1P2 
> I+P1 + P2. 



(17) 



Assume the inequality is true for m = k, i.e., 

^ k 

no+iii) > 

i.l i=l 

This is the induction hypothesis. Multiplying both sides by 1 + Pk + 1 > 0, 
we have 
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< + k + 1 k 

n(i+^i) > 1+ s 

i=l i=l i=l 



k + 1 

> 1 + £ (»i 

i=l 



The above inequality holds because all )Xi are either positive or negative. 
This completes the proof. 

Since 



«k = a-r)(l- (0<k<n-l). 



Clearly 



0<a,j<l, (0<k<n-l), 



with cx = 1 only when k = 0. 

We claim that 

(l4)--(l")^ 1 - ( ^ + (l^k<n-l). 

n n n n 

This follows from (17) with pi = - i/n and m = n-1. In this case -1 < pi < 0 
for i = 1, 2, ..., n-1. Using the definition of Ok and admitting the case k = 0, 
we conclude 
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( 18 ) 



1- ( — + (0<k<n-l). 

n n n 



Since 



0 1 k k(k+l) 

n n n 2 n 



(18) may be written as 



1 - ^ ^ ^ 1 , ( 0 < k < n-1 ). 

z n 



It follows that if = o(n) as n — >«» ( i.e., k^/n — >0 as n — >©o ), then 



> 1 as n — >oo. 



So, for example, when k < nl 



> 1 as n — >oo. 



This implies En — >«», as n — >o», and since 



E 



4c 

n 



>E 



n 



by (16), it follows that E„' — >oo as n — ><» too. 
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Thus, in both games the expected number of distinct balls obtained 
before a repetition occurs tends to infinity as the initial number of balls in the 
box tends to infinity. 



3. The Leading Asymptotic Contributions to En and En* 
In this section we shall show that 



K K 

k=0 k=0 



when 



K = 



n 



1 .c 

2 



(0<e<^). 

o 



This result determines the leading asymptotic contribution to En and En*. 
In order to show this, we shall need Bernoulli's inequality: 

(1 + x)*” > 1 + mx, if m > 1 , X > -1 and x ^ 0. 



(19) 



Bernoulli's inequality is a special case of the inequality in (17). 
Choose Pi = X for i = 1, 2, ..., m when x ^ 0 and x > -1. Then (17) implies 
(19). 

Using (19) for any positive integer k with 2 < k < n, (1- 
k/n) < (1 - 1/n)*^ , and (1 - k/n) = (1 - 1/n)*^ , fork = lork = 0. 

Now we define 
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( 20 ) 



kn = 



n 



— + E 
2 



, (0<e<g-). 



i.e 

2 



The number kn is the largest integer less then or equal to , i.e 



i.e i.e 

(n^ -l)<k^<n^ 



If k > kn, and k is an integer then 



'< k„+ 1< k 



so that 



1 2 ,2 

k 2e . - k 2e 

— > n , i.e., < -n . 

n n 



( 21 ) 



Recall that 



n-1 



E«- = S|3k+ SPi 



k=0 k=n 



If k > n. 



K = 



n n n n n 



^ n+0 n+1 n+2 **'n+n 2n+l 2n+k-n 



so that 



Pk s (i) 



1 , k -n 

r 



Consequently, 
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iPkS l2 

k=n k=n 



n-k 



= I2-' 

j=0 



^ T 



1 



>4 



= 2 



( 22 ) 



n-1 



Since E„' diverges, it follows that En* ~ 2 Pk ’ (n— >‘«). 

k=o 



Now, for k < n. 



Pk = 



n n n 



^ n+0 n+1 n+2 ” n+k 









1 " 1 ‘ 1 " 1 ' 

" <>-2S> (>-2S) 

by (19). Since the right side of the above inequality can be written as 
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0+1+2+.. .+k 



( 1 - 




9 



and 0 + 1+ 2 + ... + k = k(k + l)/2,it follows that 



P.Sd-jL) 



k(k+l) 

2 



This inequality implies 






S(e2l)>, (by(12)) 



- k 



2 



^4n 



Since (21) implies 




2e 
- n 



4 



for kn < k < n, it follows that 



2t 

- n 

Pk < (k„ < k < n). 
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Now recall from (14), that when k < n-1 



«k ^ Pk . 



Combining the last two inequalities then yields 



2c 
- n 

< e , (k„ < k < n). 



It then follows that 



n-1 



k=k,+l 



n-1 

I K 



k-k.+l 



2 c 
-n 

< ne ^ 



Since n e * — >0 as n — ><>o, it follows that 



n-1 

S “k — 

k=k„-i- 1 



(23) 



n-1 

S Pk — >0 

k=k„-(- 1 



(24) 



as n — >oo. 

Recall that 

En- = ip. 

k=0 
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kn n-1 «» 

= I Pi+ZPk 

k=0 k=k„+ 1 k=n 



Since Ep — >®® as n — >o© and the second and third sums in the above 
expression are finite by (22) and (24). It follows that 



E 



n 



kn 

(n— >~). 

k=0 



(25) 



Similarly, 



•tn n-1 

En= Z«k + Z «k 

k=0 k.+l 



Since En also diverges as n — >», and the second sum above is finite 
by (23), as n — >» we conclude 



~ Z “k > ( n— >oo). 
k=0 



(26) 
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4. The Proof that En is Asymptotic to En* 
From the above analysis, we conclude that 



En ~ S «k ’ ~ X Pk ’ ( n— >oo). 

k=0 k=0 



We shall now show that 



k k 

X «k ~ X Pk> (n->~), 

k=0 k=0 



or from (9) and (10) that 

thus proving (11). 

For 0 < k < kn , 



Ej, ~ En* as n — >oo 



Pk 



12 k 

(l-i)(l-i)...(l-^) 

n n n 

(_D_) 

^ n+1 ^ 



( ) (-^ ) (-^ ) 
^ n+1 ^ V2^-Wk^ 



2 ,2 2 .,2 2,2 



n 



n 



n 
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2 2 

(1 -(i) ) o - (|) )■•■ n -( 



a ) 



> 1 (by Bernoulli's inequality ) 

n 



> 1 - — 
2 
n 



From this analysis and (14), it follows that 

k 3 

Pk<l ^ “k ^ Pk’ (0SkSk„). 

n 



Summing the above inequality gives 



k ^ kn kn k„ 

SPk si 

n k=0 k=0 k=0 



(27) 



By the definition in (20), 



k„ = 



n 



1 . e 

2 



, (0<£<^), 



SO 
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^ I e 



3 



^ < £ 



l*3e 

2 



—♦ae 

= 



n 



Since 0 < e < 1/6 , it follows that 



k 



3 

n 



n 



2 



— >0 as n— >oo 



Letting n — ><>o in (27), we can conclude that 



k k 

k=0 k=0 



( n — >oo) 



(28) 



From (25) and (26), it then follows that 



E 



n 



E„* , (n->co). 



31 



III. STIRLING'S FORMULA 



A. THE COMMON ASYMPTOTIC VALUE OF AND E^* 
In Chapter II we proved that 



E„ ~ E„* , (n— >oo) 



In this chapter we will determine the common asymptotic value of En 
and En*. 



From (14) we have 



(O^k^n-1) 



Hence, 



Ir Ir tf 

• k(k+l) 



k=0 



k=0 



k=0 



(29) 



Letting n — >o» in (29), and using (28) we conclude 



ICn 

X®k ~ , (n — >«>), 

k=0 k=0 



( 30 ) 
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, (n — >oo). 







k 



k=0 



^ e*“ e*" 

k=0 



Consider the following inequality: 



• >• k. .i' 


k„ -k^ - k 


k„ - k" 


Xe” 


< Xe'” e“ ^ 


le - 


k=0 


k=0 


k=0 



(31) 



Since kn/ n = o(l) as n — >« , we conclude from (31) that 



li! ^ 

2e’-e“- Xe",(n->~). 



From (25), (26) and (30) it then follows that 



and 



E„~ 



k, ^ 

, (n— >«>), 

k=0 



k, V 

E„*~ Xe"-, (n->oo). 

k=0 



(32) 



(33) 



To asymptotically estimate the sum in (32) and (33), note the function 



f(x) 



X 



2 



e 
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is positive and monotone decreasing on [0 , «»). Setting 



we then have 



and 




Since 



(34) 



1 

kn > 1 , 



and k_ h = ,-Jl- , it follows that 



knh > 



1 

-?= (n' - 1 ) 

V2n 



/ 



or 



k„h 



1 , e 1 

> -?=(n--p=^). 

VI Vn 



Hence, kn h — ><» and h — >0, as n — ><». 



Letting n — >oo in (34), we conclude 




/ 



or 



34 



(35) 




VlTcn 
2 ’ 



(n— >oo). 



Equation (32), (33) and (35) then impliy 



E 



n 



V2jcn 

“2~’ 



V27cn 



(n— >«.) 



(36) 



B. THE ASYMPTOTICS OF THE EXPECTED TOTAL NUMBER OF 

DISTINCT BALLS 

In the first game considered above we defined Tn to be the expected total 
number of distinct balls obtained before winning. Let p be the probability of 
winning the game, and q = 1 - p be the probability of losing. Recall that one 
wins the game if n distinct balls are obtained consecutively and loses 
otherwise. 

Let the random variable X be the number of times we play the game 
before winning. Then 



P(X=k) = (k = 1,2,3,...). 

The probability p of winning the game, i.e., of getting exactly n distinct 
balls before a repetition, is p = pn = n!/n", by (2). 

The expected value of X is 

oo oo 

XkP(x=k) = 

k=l k=l 
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times in order to win. 



This means that, on average, we must play n*^/n! 

Therefore, the expected total number of distinct balls Tn obtained before a win 
can be represented as follows : 



This is the value of Tn because the expected number of plays is 1/p 
(=n*^/n!). Among these plays, one must be a win, and furthermore that win 
must occur on the very last play. All the other plays are losses. When we win, 
we draw out n distinct balls, and when we lose, the expected number of 
distinct balls is En. Therefore, 



This expression can be rearranged as 




T, 



n 
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From (36), 



E 



n 



V27tn 

2 



V27tn 

2 



, (n— >oo) 



So n - En = 0(n) , (n — >«>). It follows that 



T 



n 



En 

0(n) 



(38) 



Now consider En/p. Since 



E„~ 



(n — >oo). 



we can write 




2 p ' 



(n— >oo) 



(39) 



But 




I 

P 



(En + E„- 



) 



n n-1 



k=0 



oo 



SPk) 



,n , 1 n-1 n-1 n-2 n-1 n-2 1 . n n n , 
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n-1 n-2 n-3 n n + 1 n+2 

^ n n n - . .n n n . 

= ( /-- 1\l -aM +•••!)+ (^+ /- ■ 1M + 



^(n-1)! (n-2)! (n-3)i 



(n+l)l (n+2)l 



and the last expression, after rearranging, can be written as 



2 n-2 n-1 n n + 1 n+2 

( 1 + n+^+...+^^^+ 



= e 



It follows from (39) that 



j - Y • 



(40) 



With this information, letting n — >«> in (38) yields 



T„ ~ ^ , (n— >oo). 



(41) 



C STIRLINGS' FORMULA 
From (38), (40) and (41) 



En 

Tn ~ y, (n->oo) 



(42) 



i.e.. 
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( 43 ) 



T„ ~ , (n->oo), 



Since 



E„ - ^ , (n->~) 



(43) implies 



Using (41), we get 



_ n" V27cn 



e" n" V27m . . 

T - in- — • 



(44) 



or alternatively. 



n 

n! ~ — V27in , (n — >«>). 

n 

e 



This can also be written as 



n! ~ n"e " flim , (n — >««), 



and this is Stirling's formula (1). 
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IV. CONCLUSION 



We have given a new combinatorial or probabilistic derivation of 
Stirling's formula. Our derivation also gives another way to interpret 
Stirling's formula. To see this, let us consider a sp>ecific value for n. Suppose 
n = 20, i.e., there are 20 distinct balls in the box. The expected number of 
distinct balls E 20 obtained is 

19 19 18 19 18 17 19! 

20 ^■^20'^20 20 20 20 20'^"’ 20^^ 



= 5.293584585. 



This is fairly close to the asymptotic value of En as n — >«>, i.e.. 



V2ji (20) 
2 



5.604991216. 



The probability of winning a game when n = 20 is 



P 



P 20 - 



20 ! 



20 



20 



so that the expected number of plays before a win is 



1 _ 

P 



20 



20 



20 ! 



43099804 
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By (37), the expected total number of distinct balls T20 obtained before a 
win is 



T20 = 20 + (43099804- 1 )(E2 o) 

= 228152473. (45) 



The asymptotic formula (41) for Tn gives, for n = 20, 




« 242582598, 

and this is of the same order as (45). As n gets larger, the agreement between 
the exact formula for Tn and the asymptotic formula will get increasingly 
better. Notice that when n = 20 the expected number of plays before a win is 
quite large. 

To conclude, we can interpret Stirling's formula as written in (44) in the 
following way using (42). As n — >«» the expected total number of distinct 
balls obtained before a win is asymptotic to the expected number of plays 
necessary to win times the expected number of distinct balls per play. 
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